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TOMS NEAR REALTIME SYSTEM 


DESIGN DOCUMENT 


SECTION 1. GENERAL 

1 . 1 Purpose . The System Design Document for the TOMS (Total Ozone Mapping Spectrometer) 

Near Realtime System is written to fulfill the following objectives; 

a. To provide detailed definition of the system functions. 

b. To record the system history from a development and data processing point-of-view. Data 
Analysis will be the subject of future documentation. 

1.2 Project References. Listed below are references pertinent to this document. 

1 .2. 1 C Madrid, editor, “The NIMBUS 7 User’s Guide.” Prepared by the LANDSAT/ 
NIMBUS Project, Goddard Space Flight Center, National Aeronautics and Space 
Administration, August 1978. 

1.2.2 J. Green, NIMBUS G Flight Operations Software System (FOSS> Definition Report, 
General Electric Space Division, Valley Forge, Pa.. 4/27/ 77. 

1.2.3 L. BowUn, S. Stowe, “TOMS Near Realtime Data Processing Operations Manual,” 
Systems and Applied Sciences Corporation, Riverdale, Md., June 81. 

1.2.4 Author unknown, “System Memo#l, Nimbus F Tape Formats,” Rev. A, 1/31/73, 
General Electric Memo for NIMBUS Project at Goddard Space Flight Center. 

1.2.5 M. Hopkins, “ERB-6 Reprocessing Project Data Processing Subsystem Stack DT 
Program Specifications,” prepared for GSFC Code 931 by Research and Data Systems, 
Inc., January 1981. 
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1 .2.6 L. BowUn. L. Bastley, “TOMREL Maintenance Manual." prepared for GSFC Code 93 i 
by Systems and Applied Sciences Corporation, July 1981. 

1.2.7 P. Smith, “User’s Guide for the Total Ozone Mapping Spectrometer’s Interim Data 
Program TOMALL." prcpan'd for GSFC Code 93 1 by Systems and Applied Sciences 
Corporation. June 1980. 


I 3 Terms and Abbreviations. The following is a list of teims and abbreviations used in this 


document. 

DT 

ERB 

FAA 

FOV 

GMT 

GSFC 

ILT 

ILTC 

METOCC 

NOPS 

NSSDC 


RUT-T 

SACC 

SDT 

TDT 

TOMS 

UFO 


Data Tape 

Earth Radiation Budget 

Federal Aviation Administration 

Field of View 

Greenwhich Mean Time 

Goddard Space Flight Center 

Image Location Tape 

Image Location Tape (fixed) 

Meteorological Operations Control Center 

NIMBUS Observation Processing System 

National Space Science Data C<' .iter 
Goddard Space Flight Centei 
Code 601 

Greenbelt.MD 20771 

Raw Unit Tape - TOMS 

Science and Applications Computing Center 

Stack Data Tape 

Telemetry Data Tape 

Total Ozone Mapping Spectrometer 

User Formatted Output 
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SECTION 2. REQUIREMENTS 


2.1 System Description . The objective of the TOMS (Total Ozone Mapping Spectrometer) 

Near Realtime System is to demonstrate that NIMBUS 1 TOMS ozone data can be used as an aide 
in helping airlines neet FAA regulations concerning acceptable ozone levels within aircraft cabins. 
In doing this, the feasibility of processing meteorological satellite data in “near” real time will also 
be demonstrated. 

This demonstration may be regarded as consisting of two main parts. 

1. Collection, processing and delivery of data within a short enough time period to be useful 
for flight routing. 

2. Analysis to ascertain that in fact the data is useful for flight routing Ln order to avoid high 
ozone concentrations. In addition the data will be analyzed to see if it is useful for precise 
location of the jet stream and of clear air turbulence. 

This document concerns itself solely with part 1 . Results of the data analysis will be presented in 
a separate document. 

Withiri the context of part 1 the system addresses three main functional requirements. 

1. Collect and process TOMS data to give daily coverage of the North American continent 
and Hawaii. See figure 5.3-1. 

1 a. Deliver map products of each orbit of data within 6 hours of ground receipt to 
Northwest Airlines meteorologists in Minneapolis, Minn. 

2a. Deliver daily a map showing a composite of all orbits processed that same day. 

2. Operate the system from 3/1/81 through 5/15/81, 
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In order to satisfy these functional requirements the TOMS Near Realtime System was designed 
to consist of three main subsystems. See figure 2-1 . 


The general philosophy adopted in order to implement the system by 3/1/81 (starting date was 
November 1980) was to reuse as much as possible the existing NIMBUS 7 TOMS data processing 
system. See reference 1.2. 1 page 193 for details of that system. 

2.1.1 Data Receipt Subsystem. The basic function of this subsystem is to capture the 
spacecraft data, merge predictive spacecraft ephemeris with it. do some basic quality 
control and produce the results on a computer compatible digital tape. See reference 

1.2.2 for details. In addition the subsystem also produces time correction data 
(relationship between spacecraft clock times and GMT.) 

This subsystem satisfied the collection requirements for the system. The tape product 
produced was simply a copy of that which would have normally been produced for 
the existing TOMS data processing system. The chief effects our requirements had on 
the existing system were to cause some instances of special scheduling of data dumps 
from the satellite as well as scheduling the data tapes to be made within 2 hours of 
ground receipt. No new software or hardware was required. This occasional special 
scheduling and increased tape production rate was maintained for our demonstration 
period of 3/1/81 through 5/15/81 for the four orbits each day which contained day- 
light data of the North American continent and Hawaii. 

2. 1 .2 Data Processing Subsystem. The basic processing steps performed by this subsystem 
are; 


1 . Reformatting and time correction of the raw satellite data after preliminary 
quality control. 
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NIMBUS 
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Figure 2-1. TOMS Near Reailinie System Overview 





2. Stripping of the TOMS experiment data from entire satellite data stream. 

3. Determining the earth location of TOMS data based on nominal attitude ( pitch* 
roil* yaw *0) and predictive ephemeris. 

4. Computing sun angle values necessary for determining ozone. These values are 
measured at each field*of*view and are based on sotar ephemeris and spacecraft 
ephemeris. 

5. Calibration of the TOMS instrument data. 

6. Production of ozone measurements in scientific units. 

7. Formatting of the data (ozone scientific units and locations) for use in graphics 
production and anaiv'^s. 

See reference 1.2.3 for details. 

This subsystem satisfied the processing requirements for the system. A new software 
program had to be written which replaced the existing NIMBUS-7 processing steps that 
generate UFO and ILT tapes. These tapes are normally generated on the NOPS CDC 
3300 computer. Since that computer was not available for use in a priority mode, 
the entire process was transferred to the SACC IBM 360/91 computer where subsequent 
processing was already being done. Thus steps 1, 2 and 3 listed above were implemented 
by new software. Steps 4*7 were accomplished using copies of the software already 
developed for the usual NIMBUS 7 TOMS processing. The new software was combined 
with the copied software into one multi-step computer run and priority execution was 
allowed by SACC in order to meet the time requirement. 
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2. 1 .3 Graphics Prb v 'ction Subsystem. This subsystem provided the basic functions of 
reformatting the data into the required map products and delivering those products 


to Northwest Airlines Meteorological offices in Minneapolis. Minnesota. 

Modiflcations to existing software were made to produce a Lambert mapped projection 
of the total ozone data. A symbol scale was generated which provided 16 levels. 2S 
Dobson units per level, for the ran^ of 200 to 600 Dobson units. Scaled mapped data 
were transmitted to Northwest Airlines after receipt of each single orbit Ozone T data 
tape. In addition, single orbit and daily composiie four orbit images were displayed 
01 . a local terminal for evaluation and archiving. An 8 X 10 inch color photo was also 
generated for each daily composite. On “known” clear air turbulence days, the total 
ozone daily composite images were regenerated using a symbol scale of 1 6 levels, 

S Dobson units per level, for the range of 350 to 430 Dobson units and transmitted 
to Northwest Airlines for analysis. 

To meet the time limit requirements, the Sensor Evaluation Branch granted priority 
processing time on their computer and data transmission equipment as well as establish* 
ing a special work schedule for operations personnel. In addition to satisfying the basic 
functional requirements as described above, this subsystem provided visual quality 
control on the map products before transmission. Contact R. Sullivan of Code 942 for 
details. 

2.2 Accuracy . To implement the system within the available 4 months the accuracy requirements 
were specified as follows; 

“Output products from the TOMS Near Realtime System should be identical to those which 
would be produced by the usual NIMBUS 7 TOMS Processing with the possible exception of 
minor location differences due to use of predictive spacecraft ephemeris and assumed nominal 
attitude.” 
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Preliminary studies comparing predictive and definitive spacecraft ephemeris showed that the 
resulting differences in location of ozone data should not effect the proposed study. The historical 
accurate control of the spacecraft attitude by the on board Attitude Control System (ACS) was 
relied upon to make the simplifying assumption that attitude in each axis was a constant zero 
degrees. 

Comparing TOMS data processed through this system with the some data processed through the 
existing NIMBUS 7 TOMS data processing system showed that differences in ozone v.niues never 
exceeded two percent. See reference 1 .2.3 for details. 

2.3 Timing. There is a 6 hour (maximum) throughput time per orbit requirement. Therefore, 
each subsystem was allocated 2 hours to process each orbit of data. To satisfy this requirement 
special priorities were established on the computers used by the three subsystems. 

2.4 Flexibility . The software is not readily adaptable to changes in modes of operation and 
operating environment. This type of flexibility was not designed into the system due to time and 
cost constraints. 
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SECTION 3. ENVIRONMENT 


3.1 Equipment. The following subsections describe the equipment utilized by each subsystem. 

3.1.1 Data Receipt Subsystem Equipme nt. This subsystem utilizes the METOCC POP 1 1 
and COC 924 computers. 

3.1.2 Data Processing Subsystem Equipment . This subsystem utilizes the GSFC SACC 
computers (IBM 360/91 ai.d 360/75). 

3. 1 .3 Graphics Production Subsystem Equipment . This subsystem utilizes the Sensor Evalua- 
tion Branch’s Hewlett Packard 10(X) computer, a COMTaI. imaging system, two 
h'P2635 line printer/ terminal (one located in Miniieapoiis) and two P.ACAL-VADIC 
modem for transmission of the data over telephone lines from the central processor 

to the printer terminals. 

3.2 Support Softwaie. A description of the support software for .Jre Data Receipt Subsystem and 
Graphics Production Subsystem is available from the NOPS and the Sensor Evaluation Branch respec- 
tively. The support software for the Data Processing Subsystem is documented in reference 1.2.6. 

3.3 Interfaces. The following subsections describe the system interfaces. See figure 2-1. 

3.3.1 Data Receipt Interfaces. The data receipt subsystem interfaces with the Data Processing 
Subsystem via 7 track, 556 BPI tape (DT). See figure 2-1 . 

3.3.2 Data Processing Interfaces . This subsystem interfaces with the Graphics Production 
subsystem via 9 track, 800 BPI tape (OZONE-T) and with the Data Receipt Subsystem 
via 7 track, 556 BPI tape (DT). See figure 2-1 . 

3.3.3 Graphics Production Interfaces . This subsystem interfaces with the user (Northwest 
Airlines) via telephone using modems. The output map products are generated on a 
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line printer. The subsystem also interfaces with the Data Processing subsystem via 
800 BPI tape (OZONE-1). See figure 2-1. 
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SECTION 4. DESIGN DETAILS 


4.1 System Logical Flow . Figure 4.1-1 shows the logical flow of the system. 

4.2 System Data. Included in this paragraph is a description of the input, intermediate, and output 
data. 


4.2.1 Inputs. The system’s input data are the predictive orbit parameters, the spacecraft 
data, solar ephemeris tables, terrain height tables, calibration tables and time correction 
data. 

4.2.2 iu termediate Data . Intermediate data consists of data passed from computer program 
to computer program which is neither a system input or a system output product. 
There are seven m^or programs in the system and data is pas^ between them via the 
medium of magnetic tapes. All but one of these intermediate data product magnetic 
tapes are identical in format to those deflned in the normal NIMBUS 7 TOMS PROC- 
ESSING SYSTEM. These tape formats are named; 

a. Data Tape (DT) 

b. Stacked Data Tape (SDT) 

c. SBUV/TOMS User Formatted Output Tape (SBUV/TOMS UFO) 

d. SBUV/TOMS Image Location Tape (SBUV/TOMS ILT) 

e. SBUV/TOMS Fixed Image Location Tape (SBUV/TOMS ILTC) 

f. TOMS Raw Unit Tape (RUT-T) 

The DT contains ^NIMBUS 7 data for one playback (approximately one orbit of 
data) as well as predictive spacecraft ephemeris. See reference 1 .2.4. 
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The SOT contains reformatted, quau:y controlled, time corrected NIMBUS 7 data 
as well as spacecraft ephemeris data. It is identical in format to that defined in the 
NIMBUS-6 ERB Reprocessing Project. See reference 1.2.5. 

The SBUV/TOMS UFO tap*; contains only the TOMS data in the desired longitude 
range (equator to North Pole). See reference 1.2.6. 

The SBUV/TOMS iLT tape contains locations for each TOMS field-of-view. See 
reference 1.2.6. 

The SBUV/TOMS ILTC appends to the ILT various solar orientation angles measured 
at each fleld-of-view. See reference 1.2.6. 

The TOMS RUT tape contains the calibrated radiance data along with the location of 
each data value. See reference 1.2.7. 

4.2.3 Output. The System outputs are. 

a. Lambert projection maps showing ozone concentrations (both single orbit and 
daily composites). Figures 4.2. 3-1 and 4.2.3-2 show reductions of actual products 
as received by Northwest Airlines. Figure 4.2.3-3 shows a single orbit map with 
latitude and longitude lines overlayed as well as the ozone values of the various 
gray levels. 

b Ozone T tapes which contain total ozone profiles. See reference 1.2.7. 

4.3 Program Descriptions. The programs comprising the TOMS Near Realtime System are described 


in the following subsections. 





Sample Single Orbit Map Product 






4.3.1 Data Receipt Subsystem Programs. There are three main programs used in this sub- 


system. Their main functions are to capture, decommutate. add necessary Hag words 
and predictive spacecraft ephemeris and quality control the data. See tlgure 4.3. 1-1 
and reference 1.2.4 for details. 

4.3.2 Data irrocessing Subsystem Programs. There are five main programs used in this sub- 
system. They are the Stack Data Tape Program. TOMREL Program. ILT FIX Program. 
INGEST Program and TOMALL Program. In aggregate, their function is to time 
correct the satellite data, strip out the TOMS data and then select only that data from 
equator to North Pole, determine locations of each field-of-view, calibrate the instru- 
ment data and produce total ozone profiles. See figure 4.3.2- 1 and references 1.2.5 
through 1.2.7 fo> details. 

4.3.3 Graphics Production Subsystem. There is one main program used in this subsystem. 

It is called the WMAPD Program. Its main function is to produce a gray scale Lambert 
Projection map showing ozone concentrations. See figure 4.3 .3-1. Contact R. Sullivan 
Code 942 for details. 
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Figure 4.3. |.|. METOCCTOMS Dala A«,..Kilio„ md Pmcc^g P„lifc 








INTERFACE WITH THE 
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Figure 4.3.2- 1 . Data Processing Subsystem Detailed Processing Flow 
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SECTION 5. SYSTEM HISTORY 


5. 1 Definition and Design. System requirements were presented to Code 931 in a meeting in 
November 1980 by A. Krueger and R. Hudson of Code 963 along with a proposed design. Within 
the next few weeks the author showed that it would be feasible to design, implement and operate 
the Data Processing Subsystem. Work was begun immediately. This involved establishing schedules, 
interfaces among the three component subsystems, defining the responsibility of each, estimating 
cost and lime schedules, and design and implementation of the Data Processing Subsystem. See 
figure 5.1*1 for the time schedule. The resulting design has been described in section 4. 

5.2 Operations. The system was successfully able to meet the requirement of producing ozone 
maps within 6 houis of ground receipt of satellite data because the operation of each subsystem’s 
computers was run in a priority mode. It is even more important to recognize that despite having 
p.iority access to the computers involved, the operations would not have been successful had it not 
been for the high degree of integrity and responsibility displayed by the operators. 

Beginning with the Data Receipt Subsystem, that group established priority production of the 
required data tapes (Dr’s). In addition they modified the scheduling for the ground receipt of 
NIMBUS 7 data at Alaska so that our time requirements could be met. 

The Data Processing Subsystem operations not only involved executing the functions of that sub* 
system but the operator was also required to pick up input tapes x;om the Data Receipt Subsystem, 
deliver output tapes to the Graphics Production Subsystem and be responsible for the overall flow 
and accounting of data between subsystems. 

On weekends the requirement for delivering data within six hours of ground receipt were relaxed 
due to budget constraints. Sai;.irday and Sunday data were processed and delivered to the Graphic 
Production Subsystem by noon on Monday. 


5*1 




Figure S. FI . TOMS Near Real Time Processing Sclicdule 


The Graphics Production Subsystem operations were specially set up to help meet our time require 
ments. The operator hours were set so that he would be available during the hours when the first 
through fourth orbits would be received (typically noon to 8 p.m.). In addition, this subsystem 
collected the Ozone T tapes delivered to them so that they could be archived. See section S.4. 

5.3 Log of Data Processed. The data processed ran from March 1, 1981 through May 15, 1981. 

The goal was to process those orbits of NIMBUS 7 which would produce coverage of the Ncith 
American continent and Hawaii. See flgure 5.3-1. The algorithm used to select the orbits was to 
process the first four orbits of the day whose ascending nodes were west of 51 W longitude. Because 
of the daily precessior of the orbit on some days three orbits were sufficient to give the required 
coverage. See appendix A for a description of the orbits processed. It would be noted that during 
the course of operations three modifications were made to the Data Processing Subsystem software 
to correct minor problems. Each of those problems would occur only under certain rare circum- 
stances and thus processing of most of the orbits was unaffected. Eight of the 297 orbits processed 
from March 1, 1981 through May 15, 1981 were reprocessed on May 21 to remove small blocks 

of bad data. The modifications made occurred on March 27, April 15 and April 30. Each modifica- 
tion is documented in reference 1.2.3. The reprocessed orbits are identified in appendix B. 

The log kept by the Data Processing Subsystem operator is shown in appendix B. This log records 
the details of the processing of each orbit. 

3.4 Archival. The products archived for future reference include: 

a. All of the NIMBUS 7 Data recorded by NOPS which were used for this project. Each week 
of data (28 orbits) in the period March 1, 1981 through May 15, 1981 was stacked onto 
one single high density tape using the STACK DT program described in section 4.3 and in 
references 1.2.3, 1.2.5 and 1.2.6. The eleven stacked tapes generated are archived at 
NSSDC. A copy of these eleven tapes is also stored in the Information Management Branch 
tape library. Note that each orbit of data on these stacked tapes has been processed by the 
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same program which comprises the first step of che Data Processing Subsystem. Therefore, 
if this data ever needs to be reprocessed through the system, step one of the Data Process- 
ing Subsystem should be skipped. 

b. AH of the OZONE-T tapes output by the system. (These contain the ozone profiles.) The 
original OZONE-T tapes which each contain a single data file are being stacked onto fewer 
tapes each of which will contain multiple data files. The archival site will be selected by 
A. (Crueger. 

c. All of the printer generated Lamuert projection maps (both single orbit and daily four 
orbit composites) as well as the color photographs of each daily composite';. The archival 
site will be selected by A. fCraeger. 

d. All of the SACC IBM 360 computer printouts from the jobs which created the OZONE-T 
tapes from the DTs. These, as well as the jobs which created the stacked tapes referred 
to as archival item a. above, are archived at the Federal Records Warehouse. They may be 
accessed by contacting the Information Management Branch librarian, J. Cleveland. 

e. All software and input data sets which comprise the Data Processing Subsystem. These 

are archived both at the Goddard Program Library and the Information Management Branch 
Library. 

5 .5 Conclusions. The TOMS Near Realtime System has demonstrated that it is feasible to process 
TOMS data quickly enough to deliver map products to an end user within 6 hours of ground receipt 
of the satellite data. See figure 5.5-1. 

Based on the experience gained during this demonstration period it should be quite possible to 
modify the existing system to reduce the delivery time even further. There are many possible ways 
to do this. The two most significant changes which could be made are: 
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1. Combine the Data Processing Subsystem and the Graphics Production Subsystem so that 
their functions are all executed on one computer. 

2. Combine the five distinct job steps in the Data Processing Subsystem so that transmission 
of data between steps is done by using computer memory only. 
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APPENDIX A 


DATA LOG 
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Note C - Not processed until date shown due to error in software. The error did not effect other orbits. 
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